Weighted conditional kappa
نویسندگان
چکیده
منابع مشابه
Cohen’s quadratically weighted kappa is higher than linearly weighted kappa for tridiagonal agreement tables
Cohen’s weighted kappa is a popular descriptive statistic for measuring the agreement between two raters on an ordinal scale. Popular weights for weighted kappa are the linear weights and the quadratic weights. It has been frequently observed in the literature that the value of the quadratically weighted kappa is higher than the value of the linearly weighted kappa. In this paper this phenomeno...
متن کاملCohen's linearly weighted kappa is a weighted average
An agreement table with n ∈N≥3 ordered categories can be collapsed into n−1 distinct 2×2 tables by combining adjacent categories. Vanbelle and Albert (Stat. Methodol. 6:157–163, 2009c) showed that the components of Cohen’s weighted kappa with linear weights can be obtained from these n−1 collapsed 2× 2 tables. In this paper we consider several consequences of this result. One is that the weight...
متن کاملA note on the linearly weighted kappa
6 A frequent criticism formulated against the use of weighted kappa coefficients is 7 that the weights are arbitrarily defined. We show that using linear weights for a K8 ordinal scale is equivalent to deriving a kappa coefficient from K-1 embedded 2× 2 9 tables. 10
متن کاملOn The Direct Maximization of Quadratic Weighted Kappa
In recent years, quadratic weighted kappa has been growing in popularity in the machine learning community as an evaluation metric in domains where the target labels to be predicted are drawn from integer ratings, usually obtained from human experts. For example, it was the metric of choice in several recent, high profile machine learning contests hosted on Kaggle : www.kaggle.com/c/asap-aes , ...
متن کاملThe Analysis of Ordinal Agreement beyond Weighted Kappa
The weighted kappa statistic has been used as an agreement index for ordinal data. Using data on the comparability of primary and proxy respondent reports of alcohol drinking frequency we show that the value of weighted kappa can be sensitive to the choice of weights. The distinction between association and agreement is clarified and it is shown that in some respects weighted kappa behaves more...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Bulletin of the Psychonomic Society
سال: 1985
ISSN: 0090-5054
DOI: 10.3758/bf03329866